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Abstract 

Some biological systems operate at the critical point between stability and instability and this re- 
quires a fine-tuning of parameters. We bring together two examples from the literature that illustrate 
this: neural integration in the nervous system and hair cell oscillations in the auditory system. In 
both examples the question arises as to how the required fine-tuning may be achieved and maintained 
in a robust and reliable way. We study this question using tools from nonlinear and adaptive control 
theory. We illustrate our approach on a simple model which captures some of the essential features 
of neural integration. As a result, we propose a large class of feedback adaptation rules that may be 
responsible for the experimentally observed robustness of neural integration. We mention extensions 
of our approach to the case of hair cell oscillations in the ear. 



Persistent neural activity is prevalent throughout the nervous system. Numerous experiments have 
demonstrated that persistent neural activity is correlated with short-term memory. A prominent example 
concerns the oculomotor system — see ^ for a review and experimental facts. The brain moves the 
eyes with quick saccadic movements. Between saccades, it keeps the eyes still by generating a continuous 
and constant contraction of the eye muscles; thus requiring a constant level of neural activity in the motor 
neurons controlling the eye muscles. This constant neural activity level serves as a short-term memory for 
the desired eye position. During a saccade, a brief burst of neural activity in premotor command neurons 
induces a persistent change in the neural activity of the motor neurons, via a mechanism equivalent to 
integration in the sense of calculus. Neural activity of an individual neuron, however, has a natural 
tendency to decay with a relaxation time of the order of milliseconds. Therefore the question arises as to 
how a transient stimulus can cause persistent changes in neural activity. According to a long-standing 
hypothesis, persistent neural activity is maintained by synaptic feedback loops. Positive feedback can 
oppose the tendency of a pattern of neural activity to decay. If the feedback is weak, then the natural 
tendency to decay dominates and neural activity decays. As the feedback strength is increased, the neural 
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dynamics undergo a bifurcation and become unstable. When the feedback is tuned to exactly balance the 
decay, then neural activity neither increases nor decreases but persists without change. This, however, 
requires a fine-tuning of the synaptic feedback strength and the question arises as to how a biological 
system can achieve and maintain this fine-tuning |3l 1131 IT51 114| . Some gradient descent and function 
approximation algorithms performing this fine-tuning have been proposed pTllloj and a feedback learning 
mechanism based on differential anti-Hebbian synaptic plasticity has been studied in Nevertheless, 
it is still unclear how the required fine-tuning is physiologically feasible. For this reason, a different model 
for neural integration based upon bistability has recently been proposed in In the present paper, we 
do not follow the line of research based upon bistability. Instead, we pursue the hypothesis of precisely 
tuned synaptic feedback. The present paper proposes an adaptation mechanism that may be responsible 
for the fine-tuning of neural integrators and that may explain the experimentally observed robustness of 
neural integrators with respect to perturbations. Before we present this adaptation mechanism in detail, 
we first discuss a similar phenomenon in the auditory system. 

In order to detect the sounds of the outside world, hair cells in the cochlea operate as nanosensors which 
transform acoustic stimuli into electric signals. In 0J|Sl|Sl|7j these hair cells are described as active systems 
capable of generating spontaneous oscillations. Ions such as Ca ++ are believed to contribute to the hair 
cell's tendency to self-oscillate. For low concentrations of the ions, damping forces dominate and the hair 
cell oscillations are damped. As the concentration increases the system undergoes a Hopf bifurcation, 
the dynamics become unstable, and the hair cells exhibit spontaneous oscillations. In ^|SJ|S1[7] the hair 
cells are postulated to operate near the critical point, where the activity of the ions exactly compensates 
for the damping effects. As before, this requires a fine-tuning of parameters (the ion concentrations) and 
again the question arises as to how this fine-tuning can be achieved and maintained. In E] a feedback 
mechanism has been proposed which could be responsible for maintaining this fine-tuning. 

It thus seems that operating in the vicinity of a bifurcation is a recurrent theme in biology. And 
the question as to how proximity to the bifurcation point may be achieved and maintained in a noisy 
environment may be of considerable, general interest. We view the two presented examples as special 
instances of the following general problem. Consider a forced dynamical system, described by a differential 
equation x — f^{x,u{t)). The right-hand side of this equation depends on a parameter fi and the unforced 
dynamics x = /^(x, 0) are assumed to exhibit a bifurcation when /i equals a critical value /iq. The 
problem consists of finding a feedback adaptation rule for the parameter /i which guarantees proximity 
to the bifurcation point; that is, which steers (i toward its critical value fj,o- This adaptation law may 
depend on [i and x but should be independent of /xo, since this critical value is not known precisely. This 
abstract formulation captures common features of both biological examples and suggests some unexpected 
links with the literature. Questions very similar to the present one have been studied extensively in the 
literature on adaptive control [5| and stabilization [TJ\; and the general problem is closely related to 
extremum seeking |10| . and to instability detection [2], where an operating parameter is adapted on-line 
in order to experimentally locate bifurcations. 

Although the above general formulation is convenient, there is little hope that a complete and sat- 
isfactory theory can be developed that applies to all possible instances of the problem. Simplifying 
assumptions make it more tractable. In this letter, we study in detail what is probably the most simple 
but nontrivial instance of the general problem. We consider the one-dimensional system 

x = — nox + [ix + u(t), (x = dx/dt) (1) 

which captures some of the essential features of neural integration and is in fact closely related to the 
autapse model from |14| . With this interpretation, x is a strictly positive variable representing neural 
activity in the integrator network and u(t) represents the signal generated by the premotor command 
neurons. The term —[i^x corresponds to the natural decay of neural activity and fj,x represents a positive, 
synaptic feedback loop. Of course, when studying neural integration, questions can be investigated at 
varying levels of detail. It is clear that a simple model as has several limitations. Because of its 
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one-dimensional nature, the present model is, for example, unable of reproducing the distributed nature 
of persistent activity patterns observed in the brain. Nevertheless, Eq. (JJJ captures a key feature of neural 
integration: when the feedback is tuned to exactly balance the decay, Eq. (Q behaves as an integrator 
and produces persistent neural activity. Eq. is therefore a valuable model when studying fine-tuning 
of neural integrator networks |121 ITB| . 

We are interested in the fine-tuning of Eq. Q and study this question using tools from nonlinear and 
adaptive control theory. First, we ignore the presence of the input u(t) and consider the simpler equation 



We present a large class of feedback adaptation laws for © which steer fi to its critical value fio', thus 
enabling the automatic self-tuning of parameters and the spontaneous generation of persistent neural 
activity. We consider adaptation laws 1 of the form 



We show that, under three very mild conditions, this adaptation rule guarantees convergence to the 
bifurcation point for The first condition requires that g is a strictly increasing function. This means 
that the term —gin) in © acts as a negative feedback. As a consequence, if the neural activity x were 
constant in Q, then the synaptic feedback gain /i would naturally relax to a rest value depending on x 
via the equation f(x) — g(fi). The second condition states that there exists x* such that f(x*) = g(fio)- 
This condition implies that, if the neural activity would be constant and equal to x* in ©, then the 
synaptic feedback gain fi would naturally relax to its critical, desired value fio- Of course there is no 
guarantee that the neural activity would be equal to, or even converge to, this special value x* . Instead, 
the level of neural activity is governed by Eq. J5J). Therefore, in order for the adaptation law J3J to work, 
we need to impose a last condition, that / is a decreasing function. This means that the level of neural 
activity negatively regulates the synaptic feedback strength. 

We now show that, under these three conditions, the feedback adaptation law © indeed tunes the 
synaptic feedback gain /i to exactly balance the natural decay rate /io- We begin with noticing that the 
combined system of equations has a unique rest point. This equilibrium is determined by setting 

the right-hand sides of equal to zero, yielding x = x* and \x = jUq. Although the precise value 

of fio is unknown, if we are able to prove that all trajectories of converge to this (unknown) fixed 

point, then it follows that fj, indeed converges to its desired, critical value fiQ. In order to prove this, 
we introduce a coordinate transformation q = hi(x) — ln(x*) and p — fi — fiQ. This transforms |J3j| 
into q = p and p = f(exp(q)x*) — g(p + /iq). In these new coordinates, the dynamics take the form of 
a nonlinear mass-spring-damper system (with unit mass, nonlinear spring characteristic /(exp(-)x*) and 
nonlinear damping function g(- + fXo)). It follows from physical energy considerations that this system 
exhibits damped oscillations 11 . This shows that all trajectories of (0-© indeed converge to the unique 
fixed point, where \i = /xq- 

The above coordinate transformation reveals a subtle relationship between self-tuning of bifurcations 
and the internal model principle ( "IMP" ) from robust control theory (see j201 El for a discussion of the 
IMP from a systems biology perspective). This relation is made explicit by the equation q — p, which 
represents an integrator and corresponds to integral action studied in robust control theory. One regards 
the constant /iq as an unknown perturbation acting on the system. The IMP implies that, in order to 
track this constant perturbation, the system dynamics should contain integral action. The integral action 
is generated by the biological system itself, and not by the feedback adaptation law. 

We have so far ignored the presence of the signal u(t). We showed that the adaptation law © tunes 
the synaptic feedback gain to exactly compensate for the natural decay rate, resulting in the spontaneous 

lr The dynamics for fi could come from synaptic plasticity. In particular, the term f(x) might be related to types of 
synaptic plasticity that depend on the temporal ordering of presynaptic and postsynaptic spiking, as in 1191 . 



X = —[iQX + /J,X. 



(2) 



(i = f(x) - g(n). 



(3) 
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generation of persistent neural activity. At these equilibrium conditions, the action potential firing rate 
equals x*, which is related to /j,q by f(x*) — <?(/io)- In the next paragraphs, we take into account the 
effect of the input u(t). In this case, the value x* will play the role of a parameter that influences the 
accuracy with which the feedback adaptation law guarantees proximity to the bifurcation point. 

The signal u(t) will in general result in a time- varying action potential firing rate x(t). The mecha- 
nism with which this happens, is determined by the neural integrator equation Q and the adaptation 
law @. For the purpose of analysis, we make two simplifying assumptions, both of which seem to be 
natural and physically relevant for neural integration. First, we assume that, over any sufficiently large 
time interval [to, to + T], the time spent by x(t) in any interval [xi, X2] is approximately independent 
of to. In more mathematical terms, we assume the existence of a function P(x) such that for every test 
function a(x), the time average ^ J^° +T a(x(t)) dt converges to P{x)a{x)dx as T — > 00, uniformly 
with respect to to- Secondly, we assume that the adaptation law acts on a much slower time scale than 
the time variations in x(t). Under these assumptions, the effect of the action potential firing rate x{t) 
on the adaptation law may be approximated by the average effect p, = L P(x)f(x) dx — <?(/i). It is 
now clear when the adaptation law guarantees proximity to the bifurcation point: if the compatibility 
condition J Q P(x)f(x)dx = f(x*) is satisfied, then time scale separation arguments suggest that /x will 
converge approximately to fio an d the neural integrator will approximately behave as a perfect integrator. 
The compatibility condition may by interpreted as follows When the premotor command signal u(t) 
has zero time-average and the adaptation law acts on a slow time scale, then Eq. Q behaves as a good 
integrator and the firing rate x(t) equals the time-integral of u(t) plus an integration constant. The 
compatibility condition ensures that this integration constant is compatible with the desired range for 
the firing rate x(t). 

We illustrate this result on a particular example representative for saccadic eye movements. We 
consider the case of periodic saccadic eye movements asking for an action potential firing rate in the 
motor neurons alternating between 20 Hz and 60 Hz every second. At each saccade, a brief burst of 
neural activity in premotor command neurons changes the actual firing rate. We assume that this change 
is such that immediately after each saccade, the actual firing rate equals the desired firing rate. Between 
saccades, we assume that no input is applied 2 . If the neural integrator is perfectly tuned, then the actual 
firing rate will remain constant between saccades and equal to the desired firing rate (eyes are fixed). If 
the neural integrator is not perfectly tuned, then the actual firing rate will deviate from the desired firing 
rate (eyes drift) until a new saccade occurs which brings the actual firing rate to its new desired value. 
Fig. H shows the results of a simulation where the adaptation law satisfies the compatibility condition 
of the previous paragraph. In the beginning of the simulation, we have mis-tuned the neural integrator. 
Clearly, after a short transient, the adaptation law achieves excellent tuning and the drift between two 
successive saccades becomes negligible. 

We have thus shown that an adaptation law can tune a neural integrator with great accuracy to its 
bifurcation point. In order to achieve perfect tuning, however, the adaptation law itself needs to satisfy a 
compatibility condition. It seems that we have merely moved the problem of fine-tuning from the neural 
integrator to the adaptation law. The crucial observation and one of the main contributions of the present 
paper, however, is that this results in a significant decrease in sensitivity. The adaptation law is robust 
with respect to perturbations in its parameters. 

In order to illustrate this significant increase in robustness, let us first summarize the well-known |15] 
sensitivity properties of neural integration. Experiments suggest that the actual time constant obtained 
in a tuned neural integrator circuit is typically greater than 10 s; that is, — fio\ < 0.1 s _1 . This requires 
for the fine-tuning of n a relative precision A/i//z ranging from 1/100 to 1/2000, depending on whether 
the intrinsic time constant l//io equals 100 ms or 5 ms (typical values suggested in the literature). 
The required precision for /1 should be contrasted with the required precision for the parameters of 

2 We assume that no feedback is applied to keep x at its desired level between saccades, which is consistent with 
experimental observations. 
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Figure 1: Tuning of a neural integrator. Simulation of Eq. Q with (i = s(—ax — b\i + c) and u(t) = 
J2 t . 5(t — ti){xd es i ie d(ti+) — x(ti— )}, where S(-) represents the Dirac impulse and where the sum goes 
over all saccade times £j. The constants are: fio = 200 s~ x , a = 1 s _1 , 6 = 0.01 s -1 , c = 42 s~ 2 and 
e = 0.01. The adaptation law satisfies the compatibility condition a(20 Hz + 60 Hz)/2 + fe/io = c. 



the adaptation law proposed in the present paper. The simulations of Fig. [5] show that, in order to 
have |/x — /io| < 0.1 s _1 as observed in experiments, the parameters of the adaptation law need to be 
tuned with a precision of 1/20, independent of the intrinsic time constant l//xo- Comparing this with 
the originally required precision for the synaptic feedback strength /it, we conclude that the proposed 
adaptation mechanism could improve the robustness of neural integration with a factor ranging from 5 
to 100. 
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Figure 2: Robustness of tuning with respect to parameter perturbations in the adaptation law. Simula- 
tion results for Eq. Q with ji — 0.001(— ax — b/i + c) and u(t) as in Fig. The plots show the average 
value of [i — fiQ in periodic regime for different values of the parameters a, b, c and /xo- The nominal 
values of the parameters satisfy the compatibility condition a(20 Hz + 60 Hz)/2 + &/io = c and are given 
by a = 1 s -1 , b = 0.01 s"\ c = 40.1 s" 2 , l/^o = 100 ms (left) and a = 1 s _1 , b = 0.01 s _1 , c = 42 s~ 2 , 
1/Mo = 5 ms (right). 

We have studied a simple model for neural integration and proposed a class of feedback adaptation 
rules that could explain the experimentally observed robustness of neural integration with respect to 
perturbations. The analysis tools that we have introduced extend to the study of fine-tuning involved 
in other systems such as hair cell oscillations in the ear JT]. Consider the nonlinear oscillator equation 
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Figure 3: Tuning of a nonlinear oscillator. Simulation of equations x + (/zo — n)x + Xx 3 + uj 2 x = and 
fi = f(r) — g{n) with fio = 1, A = 1, cj = 1 and f(r) — g(fi) = 1/(1 + r 2 ) — \i + 1/2. The variable r is 
determined by r 2 — x 2 + (x/uj) 2 . 

x + (fj,Q — fi)x + Xx 3 + uo 2 x = u(t) , which captures some of the essential features of hair cell oscillations [S| • 
Inspired by our previous analysis, we consider a feedback adaptation law for the parameter \x of the form 
/i = f(r) — g(n), with r a positive variable characterizing the magnitude of oscillations and related to x 
and x via the expression r 2 = x 2 + (x/cu) 2 . Fig. I^Jshows that, in the absence of the stimulus u(t), this 
type of adaptation law is indeed able to bring and keep the bifurcation parameter close to its critical 
value, resulting in the spontaneous generation of oscillations. 
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